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Abstract. We provide a nontrivial upper bound for the nonnegative rank 
of rank-three matrices, which allows us to prove that [°Tp] linear inequalities 
suffice to describe a convex n-gon up to a linear projection. 



1. Preliminaries 

Consider a convex polytope P C M™. An extension [8] of P is a polytope 
Q C R d such that P can be obtained from Q as an image under a linear projection 
from M. d to M. n . An extended formulation [E1[T0] of P is a description of Q by linear 
equations and linear inequalities (together with the projection). The size [HI [ID] of 
the extended formulation is the number of facets of Q. The extension complexity [8j 
[TO] of a polytope P is the smallest size of any extended formulation of P, that is, 
the minimal possible number of inequalities in the description of Q. The number 
of facets of Q can sometimes be significantly smaller [5] than that of P, and this 
phenomenon can be used to reduce the complexity of linear programming problems 
useful for numerous applications [3] [TU] . 

An important result providing the linear algebraic characterization of extended 
formulations has been obtained in 1991 by Yannakakis [12] . Let a polytope P (with 
v vertices and / facets) be defined as the set of all points x £ l n satisfying the 
conditions Ci(x) > Pi and Cj(x) = f3j, for i € {1, . . . , /} and j G {/ + 1, . . . , q}, 
where Ci, . . . , c q are linear functionals on R™. A slack matrix S — S(P) of P is 
an f-by-v matrix satisfying Su — Ci{Pt) — Pi, where pi, . . . ,p v denote the vertices 
of P, and we note that S is nonnegative. The following well-known result (see 
Corollary 5] and also Lemma 3.1]) characterizes the rank of S(P) in terms of 
the dimension of P. 

Proposition 1.1. A slack matrix of a polytope P has classical rank one greater 
than the dimension of P. 

The result by Yannakakis points out the connection between extension complex- 
ity and nonnegative factorizations and can now be formulated as follows [H [101 [12] . 

Theorem 1.2. [101 Theorem 2] The extension complexity of a polytope P is equal 
to the minimal k for which S(P) can be written as a product of f-by-k and k-by-v 
nonnegative matrices. 

In general, the smallest integer k for which there exists a factorization A = BC 
with B 6 R" xfc and C £ R^ xm is called the nonnegative rank of a nonnegative 
matrix A £ R" xm . Nonnegative factorizations are being widely studied and used 
in data analysis, statistics, computational biology, clustering and numerous other 
applications [2] . There are still many open questions on nonnegative rank interest- 
ing for different applications, and a considerable part of them is related to providing 
the bounds on the nonnegative rank in terms of other matrix invariants [4] [8] [10] . 
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In fact, it has still been unknown whether any nontrivial upper bound for the 
nonnegative rank exists in terms of the classical rank function. It is easy to show 
that the nonnegative rank of a matrix equals [5] the classical rank if one of them 
is less than 3. However, even for a rank-three m-by-n matrix, no upper bound 
(instead of min{m, n}, which is trivial) for the nonnegative rank has been known. 

Problem 1.3. il, Conjecture 3.2] Assume n > 3. Does there exist a rank-three 
n-by-n nonnegative matrix with nonnegative rank equal to n? 



In view of Proposition 11.11 and Theorem 11.21 one can ask a related question on 
whether there exists a convex n-gon with extension complexity equal to n, for every 
n. For n < 5, Problem 1 1.31 has been solved in the positive in [S]. In [5] it was noted 
that a sufficiently irregular convex hexagon has full extension complexity, stating 
the positive answer for n = 6. For n > 7, the problem has been open. 

Lin and Chu |11| claimed a positive answer for Problem II. 31 but their argument 
has been shown to contain a gap [9] . A negative answer for Problem 11.31 has 
been obtained in [8] for a special case of so-called Euclidean distance matrices. 
The factorizations of those matrices have been studied subsequently in [9] , and the 
logarithmic upper bounds have been obtained in a number of important special 
cases. A detailed investigation of extended formulations of convex polygons has 
been undertaken in [5] , but the question about an n-gon with extension complexity 
equal to n has also been left open. 

In our paper we solve Problem 11.31 and prove that for n > 6, the answer is 
negative. In fact, we provide a nontrivial upper bound for the nonnegative rank of 
matrices in terms of classical rank and prove that an m-by-n rank-three matrix can- 
not have nonnegative rank greater than 6m " 1 l m '"l _ yy e a j so answer the question 
on extension complexity and show that a convex n-gon has extension complexity 
at most \ • That is, we prove that any convex n-gon admits a description with 
I'y] linear inequalities up to a projection. 

The organization of the paper is as follows. In the second section, we prove the 
main result in a special case of slack matrices of convex heptagons, thus showing 
that any convex heptagon admits a description with six linear inequalities. In the 
third section, we use those results and prove the main results of our paper, which 
include the upper bounds for the extension complexity of a polygon and for the 
nonnegative rank of a rank-three matrix. 



2. Factoring a slack matrix of a convex heptagon 

In this section, we will prove that slack matrices of convex heptagons have non- 
negative ranks less than 7. The considerations of this section deal with matrices 
having not more than seven rows and seven columns, and we adopt the following 
convention in order to make the presentation more concise. 

Convention 2.1. Throughout this section, the row and column indexes of the 
matrices considered are to be understood as the elements of the ring Z/7Z. In 
particular, ^3+6,6+1 wm stand for the (2, 7)th entry of a matrix A. Also, we will 
use the letters i and j only for denoting such indexes in the present section, and 
we operate with i and j as with elements from Z/7Z, throughout the section. 
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Let us introduce a certain special form of matrices which will be important for 
the considerations of the present section. By W[i,j, k] we denote the submatrix of 
W formed by the rows with indexes i, j, and k. 



Notation 2.2. Given a real vector a 
denote the 7-by-3 matrix 



(01,02,03,61,62,63). By W(a) we will 



1 1 01 02 a 3 
10 11 1 1 

1 1 61 6 2 63 

and by V(a) the 7-by-7 matrix with (i, j)th entry equal to det W[i — l,j — 2,j — i\. 

The following lemma points out a symmetry in the construction of V. 

Lemma 2.3. Matrices V(oi, 02, as, b\, 62, 63) and V(b 3 , 62, 61, a 3 , 02, a\) coincide up 
to relabeling the rows and columns. 

Proof. Perform the permutation (16) (25) (34) on the row indexes and (17) (26) (35) 
on the column indexes of V(b 3 , 62, 61, 03, a 2 , ai). □ 

Let us present a useful special case when the nonnegative rank of V is not full. 

Lemma 2.4. Given a real vector ip — (01,02,03,61,62,63) for which the matrix 
V = V(ip) satisfies V^ > if i — If cn + 61 > o 2 + 6 2 anda 3 + b 3 > a 2 + 6 2; 
then V has nonnegative rank less than 7. 



Proof. One can check that V = FG, where 



F 






V 31 
V 41 

-a 2 + a 3 - 6 2 + 63 
V 61 




G 







1 
1 

v sl + v 37 
v 31 



Vu + V i7 

1 
1 





v i7 



Ol - 



v 61 

a 2 + 61 - 6 2 
V37 

v 47 







\ 
1 
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/ 



/ 1 


v 32 /v 31 
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V 2 i/V 31 
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v 13 


1 


v 65 
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v 57 /v i7 




















v 65 /v 47 


1 


V v 72 








1 








v 57 J 



□ 



Now we show how can one construct new full-rank matrices from given. 

Lemma 2.5. Given a real vector tp — (01,02,03,61,62,63) for which the matrix 
V = V(ip) satisfies Vij > if i £ {j - Take ai = (1 - a 3 - 6 3 )/(l - 63), 

a 2 = (01 - 0163 - a 3 + a 3 bi)/{a\ - 0163), a 3 = (a 2 - a 2 b 3 - a 3 + a 3 b 2 )/ (a 2 - a 2 b 3 ), 
/?i = o 3 , /3 2 = 03/01, P 3 = a 3 /a 2 . Then the matrix U = V (ai, a 2 , a 3 , f$\, fa, P3) 
satisfies Uij > if i £ {j,j + 1} and has nonnegative rank equal to that ofV. 
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Proof. One can check that V = Q1UQ2, where 



Qi 



t 



1 
1 







V 02/03 







02(1 - 03) 





V 

Since the numbers 1 — I 
result follows. 






03(1 - 03) 





= V42, ai = 
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() 
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l/a 3 
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l/a 3 


















ai/a 3 
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«3 
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1-63 

















a 1 (l-b 3 


) 





«3 





^63; a 2 = V? 3 , and a 3 = V13 are positive, the 

□ 



The following six real sequences will be important in our considerations. 

Notation 2.6. Given a real vector tp = (ax, a 2 , a 3 , bx, b 2 , b 3 ) for which the matrix 
V = V(4>) satisfies Vij > if i ^ {j — 1, j}. We will consider the six sequences 
ai(t), a2{t), a 3 (t), ft (i), ft(i), and (3 3 (t) of reals defined by ai(0) = ax, 012(0) = a 2 , 
a 3 (0) = a 3 , ft(0) = h, ft(0) = b 2 , ft(0) = 63, and also 

1 - a 3 (t) - ft(t) 



a x+1 (t + l) 



a x (t) - a x {t)(3 3 (t) - a 3 {t) + a 3 (t)(3 x {t) 
a x (t) - a x (t)fo(t) 



for yG{1,2}, 



ft(t + l) = a 3 (i), p 2 (t+l) = a 3 (t)/at(t), ft(i + 1) = a 3 (t)/a 2 (t). 

Remark 2.7. Lemma l2~5l shows that the sequences ai(t), a 2 (t), a 3 (i), /?i (i), /?2 (t) , 
and ft(i) are well defined. 

It turns out that the sequences introduced are in fact cyclic. 

Lemma 2.8. Given a real vector ip = (ax,a 2 ,a 3 ,bx,b 2 ,b 3 ) for which the matrix 

V = V(V0 satisfies Vij > if i ^ {j — Then ai(7) = a%, a 2 (7) = 02, 
03(7) = a 3 , ft (7) = 61, ft(7) = b 2 , 03(7) = 63. 

Proof. By routine computation. □ 
The following lemma gives a necessary condition for a matrix to be full-rank. 

Lemma 2.9. Given a real vector ip = (ai,a 2 ,a 3 ,bx,b 2 ,b 3 ) for which the matrix 

V = V(ip) satisfies Vij > if i £ { j - 1, j}. TTien a x (2) + ft (2) < o 2 (2) + ft (2) 
implies that 0:2(6) + ft (6) < 03(6) + ft (6). 



Proof. A routine computation shows that 
o 2 (2)+ft(2)-o 1 (2)-ft(2) = 



(-q 3 + q 2 (1 - 63)) V32V21 
V31V73V42V52 
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so the sign of a 2 (2)+/3 2 (2) — ai(2) — j3i(2) equals that of —03 + 02(1 —63). Similarly, 

frt , a ia\ Ir\ a (r\ ^46 (~a 3 + ai(l - 63)) 
"3(6) + /3 3 (6) - a 2 (6) - /3 2 (6) = — — , 

V\5 ^36 

so the sign of a 3 (6) + /3 3 (6) — 02(6) — f3 2 (6) is that of — a 3 + ai(l — 63). It remains 
to note that 1 — 6 3 = V42 > and a\ — 02 = V37 > 0. □ 

In fact, we can obtain a stronger condition that holds for full-rank matrices. 

Lemma 2.10. Given a real vector tp = (<zi, 02, a 3l 61, b 2l 6 3 ) /or which the matrix 
V = V(ip) satisfies Vij > if i ^ {j — awe? ftas /uii nonnegative rank. Then 
either ai(t) + j3\(t) < a 2 (t) + fa(t) < a 3 (t) + /3 3 (t) for every t or ai(t) + /?i(t) > 
a 2 (i) + /3 2 (t) > a 3 (t) + f3 3 (t) for every t. 

Proof. Assume that a\{t)+ (3\{t) < ct 2 {t) +/3 2 (t), for some t. Applying Lemm.a l2.9l to 
the vector Tp' = (a%(t+5), a 2 (t+5), a 3 (t+5), pi(t+5), (3 2 (t+5), f3 3 (t+5)) and taking 
into account Lemma f2TSl we obtain that a 2 (t + 4) + (3 2 (t + 4) < a 3 (t + 4) + f3 3 (t + 4). 
Lemma E3 then shows that a>x(t + 4) + f3i(t + 4) < a 2 (t + 4) + (3 2 {t + 4), and we 
conclude that ai(t+4fc)+/3i(t+4fc) < a 2 (t+Ak)+f3 2 (t+Ak) < a 3 (i+4fc)+/3 3 (t+4fc), 
for any positive integer k. 

Now assume ai(t)+(3 1 (t) > a 2 (t)+(3 2 (t). By Lcmma l2.41 we have ao(t) + 6o(t) > 
a 3 (t) + p 3 (t), and so by LemmaCIl a x {t + 3) + /3x(t + 3) > a 2 (t + 3) + fi 2 {t + 3). 
Finally, we conclude that a x (t + 3k) + /3 x (i + 3fc) > a 2 (t + 3fc) + f3 2 (t + 3k) > 
a 3 (t + 3k) + (3 3 (t + 3k), for any positive k. □ 

Finally, let us show that a matrix V{tp) can not have full nonnegative rank. 

Lemma 2.11. Given a vector ip = (ai,a 2 ,a 3 ,bi,b 2 ,b 3 ) for which the matrix V = 
V(V0 satisfies Vij > if i ^ {j — Then V has nonnegative rank less than 7. 

Proof. Assume the converse and apply the results of Lemma 12.31 and Lemma 12.101 
We can assume without a loss of generality that a\{t) + (3i(t) < a 2 (t) + (3 2 (t) < 
a 3 (t)+f3 3 (t), for any nonnegative integer t. Note that a 3 (0)+/3 3 (0) — ai(0)—/?i(0) = 
fl 3 + 63 — <2i — 61, and routine computations also allow us to check that 

Via {h + (o! - 1)63) 



a 2 (2)+0a(2)-ai(2)-0i(2) = 



^63^42 

V 13 V 2 i (02(1 - b 3 ) - a 3 ) 



V7 3 V 3 iVa2Vc> 2 

Noting that also 1 — b 3 = V42 > and V 3 i = ai — a 2 > 0, we obtain 

(2.1) 63(1 - ai) < 61, a 3 <a 2 (l-6 3 ), a 3 + b 3 >ai+bi, 63 < 1, and ai > a 2 . 

Now let us check that (|2.ip is a contradiction. In fact, the first of these inequal- 
ities implies a\ + &i > a\ + b 3 — b 3 ai, taking into an account the third we obtain 
a 3 + b 3 > ai + b 3 — b 3 a\. Thus we have a 3 > 01(1 — 63), which implies a 3 > a 2 (l — b 3 ) 
because of the last two inequalities. □ 

Let us now check that 7-by-7 matrices of a more general form have nonnegative 
rank at most 6 as well. By U[ri 1 r 2 ,r 3 \ci,c 2l c 3 ] we denote the submatrix of U 
formed by the rows with indexes r±, r 2 , r 3 and columns with c\ , c 2 , c 3 . 

Lemma 2.12. Assume that a 1-by-l matrix U has classical rank 3 and satisfies 
Uij — if i G {j — l,j} and Uij > otherwise. Then U has nonnegative rank less 
than 7. 
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Proof. Denote by U' the matrix obtained from U by multiplying the third column 
by U54/U53, the fifth column by U24/U25, the third row by jj^u , the fourth row 
by u^Usi ' ^ e row 1 (for i' from 1, 2, 5, 6, 7). So we have 



Since U' has classical rank 3, there are certain real constants ci, . . . , C7 such that 



/ 








«3 


1 


h 




U[ 7 






u' 21 








1 


1 


u 26 


















1 




^37 










f 










u'„ 






UL 


u' 52 


f 


1 








^7 








u' Q2 


ax 


1 


61 










V 





u 72 


a 2 


1 


b 2 


u 7e 





) 



Cj detU'[i,j — 1 , j 1 3 , 4 , 5], for any i and j. Therefore, 



we obtain U', 

from Notation 12.2 



Cj Vij 



for any i and j, where V is the matrix V(a±, a 2 , 03, 61, b 2 , 63) 
Since V13 = V32 and V72 = V21, the numbers ci, C2, and C3 are of the same sign. 
Similarly, V65 = V46 and V?e = V57, so that the numbers C5, C6, and C7 are of the 
same sign as well. Further, since V24 = V25 — V43 = 1, we obtain 03 = 04 = 05 = 1, 
and the numbers c\ , . . . , C7 are thus all positive. So we can conclude that U and 
V coincide up to multiplying the rows and columns by positive numbers, and the 
result then follows from Lemma \2. Ill □ 

Now we can prove the main result of the present section. 

Theorem 2.13. A slack matrix of a convex heptagon has nonnegative rank at most6. 



Proof. Proposition 11.11 shows that the slack matrix S of a convex heptagon has 
classical rank equal to 3. Therefore, S satisfies the assumptions of Lemma \2. 121 up 
to renumbering the rows and columns. □ 

3. Main results 

In this section we prove the main results of our paper. Let us start with a 
corollary of Theorem 12 . 131 which gives a positive answer for Problem ll.3l in the case 
n = 7. 

Theorem 3.1. Let A be a nonnegative 7-by-n matrix with classical rank equal to 
3. Then the nonnegative rank of A does not exceed 6. 

Proof. Consider the standard simplex A consisting of points (x%, . . . , Xt) with non- 
negative coordinates satisfying Yli=i x i = 1- Since A contains 7 facets, the inter- 
section of A with the column space of A is a polygon I with k vertices, and k < 7. 
Form a matrix S of column coordinate vectors of vertices of /, then A = SB with 
B nonnegative. If k < 7, then the result follows directly from that A = SB, and 
if k = 7, then by Theorem 12.131 S has nonnegative rank less than 7 being a slack 
matrix for /. □ 

Now we can provide a nontrivial upper bound for the nonnegative rank of matri- 
ces with classical rank equal to 3, thus providing a negative solution for Problem ll.3l 
in the case n > 7. 



Theorem 3.2 

exceed 



The nonnegative rank of a rank-three matrix A G 

6 min{m,n} 
7 



does not 
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Proof. By Theorem 13.11 any seven rows of A can be expressed as linear combina- 
tions with nonnegative coefficients of certain six nonnegative rows, so the nonncg- 
ative rank of A does not exceed |~^p] • The nonnegative rank is invariant under 
transpositions, so the result follows. □ 

Together with the result from [6] , where it was noted that a sufficiently irregular 
convex hexagon has full extension complexity, Theorem 13.21 provides a full answer 
for Problem II .31 Namely, the following result is true. 

Theorem 3.3. If n > 7, then the nonnegative rank of any rank-three m-by-n 
nonnegative matrix is less than n. For k G {3,4,5,6}, there are k-by-k rank-three 
matrices with nonnegative rank equal to k. 

Finally, we can prove an upper bound for the extension complexity of convex 
polygons. 

Theorem 3.4. The extension complexity of any convex n-gon does not exceed \^~\ ■ 

Proof. By Proposition ! 1 . 1 1 and Theorem l3.2| the nonnegative rank of a slack matrix 
does not exceed [~^pl , so the result follows from Theorem 11.21 □ 

The author is grateful to the participants of the workshop on Communication 
complexity, Linear optimization, and Lower bounds for the nonnegative rank of 
matrices held at Schloss Dagstuhl in February, 2013, for enlightening discussions 
on the topic. 
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